CLAIMS 



1 A method for storing data in a data storage system that 
inoiudes primary and secondary storage subsystems, including 
respective first and second volatile cache memories and 
respective first and second non-volatile storage med.a, 

method comprising: . „ ,„ 

receiving the data at the primary storage subsystem 

from a host processor; 

^ t 4. *-v,» first volatile cache memory in 
writing the data to the first voiau 

the primary storage subsystem; 

copying the data from the primary storage subsystem to 

the secondary storage subsystem; 

to the second volatile cacne 
writing the copied data to tne 

memory in the secondary storage subsystem; 

returning an acknowledgment from the secondary storage 
subsystem to the primary storage subsystem 

■ ^ H-hs to the second volatile cache memory 
writing the copied data to tne seco „ nai -np 

, hp Hata in the second non-volatile 
and prior to saving the data in 

3t °TignaUng the host processor that the data have been 
stored in the data storage system responsively to 
acknowledgment from the secondary storage subsystem; and 

transferring the data in the primary and s condary 
storage subsystems from the first and second volatile c he 
emeries to the first and second non-volatile storage medra, 

respectively. 
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2 The method according to claim 1, wherein copying the 
data comprises transmitting the data between mutually- remote 
sites over a communication link between the sites. 

3 The method according to claim 1, wherein the second 
volatile cache memory and the second non-volatile storage 
media are located in mutually-remote sites, and wherean 
transferring the data comprises transmitting the data from 
the second volatile cache memory to the second non-volatxle 
storage media over a communication link between the sxtes. 



4 The method according to claim 1, wherein copying the 
data comprises creating a mirror on the secondary storage 
subsystem of the data received by the primary storage 

15 subsystem. 

5 The method according to claim 4, and comprising, upon 
occurrence of a failure in the primary storage subsystem, 
configuring the secondary storage subsystem to serve as the 

=„ aa to receive further data from 
20 primary storage subsystem so as to receiv 

the host processor to be stored by the data storage system. 

« The method according to claim 4, wherein the second 
volatile cache memory is located in a site remote from the 
25 primary storage subsystem and is operated by a serv.ce 
provider other than an owner of the primary storage 
subsystem, and wherein transferring the data from the second 
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volatile cache memory to the second non-volatile storage 
media comprises processing the data on a f ee-per-service 
basis . 

7 The method according to claim 1, wherein transferring 
the data comprises sending a message from the secondary 
storage subsystem to the primary storage subsystem 
indicating addresses of the data that have been transferred 
to the second non-volatile storage media, and wherein the 
method further comprises creating a record on the primary 
storage subsystem of the addresses of the data copied to the 
secondary storage subsystem, and updating the record xn 
response to the message. 

8 The method according to claim 7, and further 
comprising, upon recovery of the system from a failure of 
the secondary storage subsystem, conveying, responsively to 
the record, a portion of the data from the primary storage 
subsystem to be stored on the secondary storage subsystem. 

9 The method according to claim 8, wherein updating the 
record comprises removing from the record the addresses of 
the data that have been transferred to the second non- 
volatile storage media. 

10 The method according to claim 7, wherein creating the 
record comprises marking respective bits in a bxtmap 
corresponding to addresses of the data copied to the 
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secondary storage subsystem and wherein updating the record 
comprises clearing the respective bits. 

U The method according to claim 7, wherein transferring 
the data comprises transferring the data in a range of the 
addresses from the second volatile cache memory to the 
second non-volatile storage media, and wherein sendrng the 
message comprises informing the primary storage subsystem 
that the data in the range have been transferred, so that 
th e primary storage subsystem updates the record wxth 
respect to the range. 

12 The method according to claim 11. wherein transferring 
the data in the range comprises destaging the range of the 
addresses. 

» The method according to claim 11, wherein creating the 
record comprises maintaining a mirror of the record on the 
secondary storage subsystem, and wherein transferring the 
data in the range comprises selecting the data to be 
transferred from the second volatile cache memory to the 
second non-volatile storage media responsrvely to 



mirror. 



., 14 The method according to claim 1, wherein transfers 
the data comprises sending a message from the primary 
storage subsystem to the secondary storage subsystem 
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indicating addresses of the data that have been transferred 
to the first non-volatile storage media, and wherein the 
method further comprises creating a record on the secondary 
storage subsystem of the addresses of the data copied to the 
secondary storage subsystem, and updating the record m 
response to the message. 

15 The method according to claim 14, and further 
comprising, upon recovery of the system from a failure of 
the primary storage subsystem, conveying, responsively to 
the record, a portion of the data from the secondary storage 
subsystem to be stored on the primary storage subsystem. 

i Maim i R wherein updating the 

16. The method according to claim lb, wnere v 

. „ fvn(n record the addresses of 

record comprises removing from the recora 

hransf erred to the primary non- 
the data that have been transrerreu 

volatile storage media. 

17 The method according to claim 14, wherein creating the 
record comprises marking respective bits in a bitmap 
corresponding to addresses of the data copied to the 
secondary storage subsystem, and wherein updating the record 
comprises clearing the respective bits. 

pisim 14 wherein transferring 
; is The method according to claim 14, 

•™ hr^n^ferrinq the data in a range of the 
the data comprises transferring w 

<-v, e firqt volatile cache memory to the first 
addresses from the first voidunc 



IL920030033US1 " 30 



non-volatile storage media, and wherein sending the message 
comprises informing the secondary storage subsystem that the 
data in the range have been transferred, so that the 
secondary storage subsystem updates the record with respect 
to the range. 

19 The method according to claim 18, wherein transferring 
the data in the range comprises destaging the range of the 
addresses. 

20 The method according to claim 18, wherein creating the 
record comprises maintaining a mirror of the record on the 
primary storage subsystem, and wherein transferring the data 
in the range comprises selecting the data to be transferred 
from the first volatile cache memory to the first non- 
volatile storage media responsively to the mirror. 



21 A data storage system, comprising: 

a primary storage subsystem, which comprises a fxrst 
volatile cache memory and first non-volatile storage medxa; 

a secondary storage subsystem, which comprises a second 
volatile cache memory and second non-volatile storage medxa, 

wherein the primary storage subsystem is arranged to 
receive data from a host processor, to write the data to the 
first volatile cache memory, to copy the data to the 
secondary storage subsystem, and to transfer the data from 
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the first volatile cache memory to the first non-volatile 

storage media, and 

wherein the secondary storage subsystem is arranged to 
receive and write the copied data to the second volatile 
cache memory, to transfer the data from the first volatile 
cache memory to the first non-volatile storage media, and to 
return an acknowledgment to the primary storage subsystem 
responsively to writing the copied data to the second 
volatile cache memory and prior to transferring the data to 

the second non-volatile storage media, 

wherein the primary storage subsystem is arranged to 

signal the host processor that the data have been stored in 

»4-««n rpcnnnsivelv to the acknowledgment 
the data storage system responsivexy 

from the secondary storage subsystem. 

22 The system according to claim 21, wherein the primary 
and secondary storage subsystems are located at mutually- 
remote sites, and are coupled to communicate over a 
communication link between the sites. 



j' „ nia-im 21 wherein the second 
23 The system according to claim zi, 

volatile cache memory and the second non-volatile storage 
m edia are located in mutually- remote sites, and W herern th. 
secondary storage subsystem is arranged to transfer the data 
from the second volatile cache memory to the second non- 
volatile storage media over a communication link between the 



sites . 
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2i The syste* according to claim 21, wherein the secondary 
storage subsystem is arranged to mirror the data held by the 
primary storage subsystem. 

j , . laini 04 wherein the secondary 

5 25 The system according to claim ^4, 

storage subsystem is configurable, upon occurrence of a 
failure in the primary storage subsystem, to serve as the 
rimary storage subsystem so as to receive further data from 
the host processor to be stored- by the data storage system. 

26 . The system according to claim 21. wherein the second 
volatile cache memory is located in a site remote from the 
primary storage subsystem and is operated on a fee-per- 

, . hv a service provider other than an owner of 
service basis by a service 

15 the primary storage subsystem. 

fn . lflim 21 wherein the secondary 
27. The system according to claim 21, wn 

Ac a -rranaed to send a message to tne 
storage subsystem is arranged to 

3 . . .jj, 0 sooo or the aara 



20 



25 



storage Buwy»- - ^ dresS es of the data 

primary storage subsystem -Seating ad 
that have been transferred to the second 

arranged to create a record o £ the addresses 
copied to the secondary storage subsystem, and up 
record in response to the message. 

28 The system according to claim 27. wherein the primary 

a „mn recovery of the system 
storage subsystem is arranged, upon recovery 
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from a failure of the secondary storage subsystem, to 
convey, responsively to the record, a portion of the data 
from the primary storage subsystem to be stored on the 
secondary storage subsystem. 

29 The system according to claim 28, wherein the primary 
storage subsystem is arranged to remove from the record the 

j . have been transferred to the 

addresses of the data that nave oeen 

second non-volatile storage media. 

30 The system according to claim 27, wherein the primary 
storage subsystem is arranged to create the record by 
m arking respective bits in a bitmap corresponding to 

* 1_» Hai-a copied to the secondary storage 
addresses of the data copieu l. 

j-s*-<=> t-he -record bv clearing tne 
subsystem, and to update the record 

respective bits in response to the message. 



20 



31 The system according to claim 27, wherein the secondary 
storage subsystem is arranged to transfer the data over a 
range of the addresses from the second volatile cache memory 
to the second non-volatile storage media, and to indicate in 
th e message that the data in the range have been 
transferred, so that the primary storage subsystem updates 
the record with respect to the range. 



25 
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32 The system according to claim 31, wherein the secondary 
storage subsystem is arranged to transfer the data by 
destaging the range of the addresses. 

33 The system according to claim 31, wherein the secondary 
storage subsystem is arranged to maintain a mirror of the 
record, and to select the data to be transferred from the 
second volatile cache memory to the second non-volatile 
storage media responsively to the mirror. 

34 The system according to claim 21, wherein the primary 
storage subsystem is arranged to send a message to the 
secondary storage subsystem indicating addresses of the data 
that have been transferred to the first non-volatile storage 
media, and wherein the secondary storage subsystem is 
arranged to create a record of the addresses of the data 
copied to the secondary storage subsystem, and to update the 
record in response to the message. 

4-^ ni=-im ^4 wherein the secondary 
35 The system according to claim it, 

storage subsystem is arranged, upon recovery of the system 

from a failure of the primary storage subsystem, to convey, 

• i r-o the record, a portion of the data from the 
responsively to tne recoxu, a F 

stored on the primary 
secondary storage subsystem to be stored 

storage subsystem. 
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36 The system according to claim 35, wherein the secondary 
storage subsystem is arranged to remove from the record the 
addresses of the data that have been transferred to the 
first non-volatile storage media. 

37 The system according to claim 34, wherein the secondary 
storage subsystem is arranged to create the record by 
marking respective bits in a bitmap corresponding to 
addresses of the data copied to the secondary storage 
subsystem, and to update the record by clearing the 
respective bits in response to the message. 

38 The system according to claim 34, wherein the primary 
storage subsystem is arranged to transfer the data over a 
range of the addresses from the first volatile cache memory 
to the first non-volatile storage media, and to indicate xn 
the message that the data in the range have been 
transferred, so that the secondary storage subsystem updates 
the record with respect to the range. 

39. The system according to claim 38, wherein the primary 

t~ ia arranaed to transfer the data by 

storage subsystem is arrangeu 

destaging the range of the addresses. 

40 The system according to claim 38, wherein the primary 
storage subsystem is arranged to maintain a mirror of the 
record, and to select the data to be transferred from the 
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first volatile cache memory to the first non-volatile 
storage media responsively to the mirror. 

41 A computer software product for use in a data storage 
system including primary and secondary storage subsystems, 
which include respective first and second control units 
respective first and second volatile cache memories, and 
respective first and second non-volatile storage medxa, the 
product comprising a computer -readable medium in which 
program instructions are stored, which instructions, when 
rea d by the first and second control units, cause the first 
control unit to receive data from a host processor, to write 
the data to the first volatile cache memory, to copy the 
data to the secondary storage subsystem, and to transfer the 
data from the first volatile cache memory to the first non- 
volatile storage media, and cause the second control unit to 
receive and write the copied data to the second volatile 

t-« transfer the data from the first volatile 
cache memory, to transrer tne 

i-« rhP first non-volatile storage media, and 
cache memory to the nrst nun ^ 

prior to transferring the data to the second non-volatile 
storage media, to return an acknowledgment to the primary 
storage subsystem responsively to writing the copied data to 
the second volatile cache memory, wherein the instructs 

further cause the first control unit to signal the host 
processor that the data have heen stored in the data storage 

system responsively to the acknowledgment from the secondary 

storage subsystem. 
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42 The product according to claim 41, wherein the primary 
and secondary storage subsystems are located at mutually- 
remote sites, and wherein the instructions cause the first 
and second control units to communicate over a communication 
link between the sites. 

43 The product according to claim 41, wherein the second 
volatile cache memory and the second non-volatile storage 
m edia are located in mutually-remote sites, and wherein the 
instructions cause the second control unit to transfer the 
data from the second volatile cache memory to the second 
non-volatile storage media over a communication Xi* between 
the sites. 

j- ~ t-n riaim 41, wherein the 

44 The product according to claim *x, 

instructions cause the first and second control units to 
mirr or the data held by the primary storage subsystem on the 
secondary storage subsystem. 

j i Maim 44, wherein the 

45 The product according to claim **, 

^ secondary storage subsystem, upon 
instructions cause the secondary a 

occurrence of a failure in the primary storage subsystem to 
serve as the primary storage subsystem so as to receive 
further data from the host processor to be stored by the 
i data storage system. 
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46 The product according to claim 44, wherein the second 
volatile cache memory is located in a site remote from the 
primary storage subsystem and are operated by a service 
provider other than an owner of the primary storage 
subsystem, and wherein the instructions cause the second 
control unit to transfer the data from the second volatile 
cache memory to the second non-volatile storage medxa on a 
f ee-per-service basis. 

47 The product according to claim 41, wherein the 
instructions cause the second control unit to send a message 
to the primary storage subsystem indicating addresses of the 
data that have been transferred to the second non-volatUe 
storage media, and further cause the first control unit to 
create a record of the addresses of the data copied to the 
secondary storage subsystem, and to update the record a 
response to the message. 

48 The product according to claim 47, wherein the 
instructions cause the first control unit, upon recovery of 
the system from a failure of the secondary storage 
subsystem, to convey, responsively to the record, a portion 
of the data from the primary storage subsystem to be stored 
on the secondary storage subsystem. 

t-^ rlaim 48, wherein the 
49 The product according to claim *o, 

t-v,* fir«?t control unit to remove from the 
instructions cause the first conuui 
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record the addresses of the data that have been transferred 
to the second non-volatile storage media. 

50. The product according to claim 47, wherein the 
instructions cause the first control unit to create the 
record by marking respective bits in a bitmap corresponding 
to addresses of the data copied to the secondary storage 
subsystem, and to update the record by clearing the 
respective bits in response to the message. 



51. The product according to claim 47, wherein the 
instructions cause the second control unit to transfer the 
data over a range of the addresses from the second volatile 
cache memory to the second non-volatile storage media, and 
to indicate in the message that the data in the range have 
been transferred, so that the first control unit updates the 
record with respect to the range. 



52 . The product according 
instructions cause the second 
data by destaging the range of 



to claim 51, wherein the 
control unit to transfer the 
the addresses. 



53. The product according to claim 51, wherein the 
instructions cause the second control unit to maintain a 
mirror of the record, and to select the data to be 
transferred from the second volatile cache memory to the 
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second non-volatile storage media responsively to the 
mirror. 



54. The product according to claim 41, wherein the 
instructions cause the first control unit to send a message 
to the secondary storage subsystem indicating addresses of 
the data that have been transferred to the first non- 
volatile storage media, and further cause the second control 
unit to create a record of the addresses of the data copied 
to the secondary storage subsystem, and to update the record 
in response to the message. 

55. The product according to claim 54, wherein the 
instructions cause the second control unit, upon recovery of 
the system from a failure of the primary storage subsystem, 
to convey, responsively to the record, a portion of the data 
from the secondary storage subsystem to be stored on the 
primary storage subsystem. 

56. The product according to claim 55, wherein the 
instructions cause the second control unit to remove from 
the record the addresses of the data that have been 
transferred to the first non-volatile storage media. 

57. The product according to claim 54, wherein the 
instructions cause the second control unit to create the 
record by marking respective bits in a bitmap corresponding 
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4= ^ C copied to the secondary storage 

to addresses of the data copiea 

j <-v>o rprord bv clearing tne 

subsystem, and to update the record oy 

respective bits in response to the message. 

58 The product according to claim 54, wherein the 
instructions cause the first control unit to transfer the 
data over a range of the addresses from the first volatile 
cache memory to the first non-volatile storage media, and to 
indicate in the message that the data in the range have been 
transferred, so that the secondary storage subsystem updates 
the record with respect to the range. 



j'^^ t-o claim 58, wherein the 

59 The product according to claim o°, 

first control unit to transfer the 
instructions cause the first contiu 

■ v. _ van™* <~>f the addresses . 
data by destaging the range or ens 

rlaim 58, wherein the 

60 The product according to claim 

v-v^ first control unit to maintain a 
instructions cause the first concr 

j t-r. splect the data to oe 

mirror o£ the record, and to select 

transferred from the first volatile cache memory to the 
first non-volatile storage media responsively to the mirror. 
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